general architecture
Generating Privacy-Preserving Personalized Advice with Zero-Knowledge Proofs and LLMs
Watanabe, Hiroki, Uchikoshi, Motonobu
Large language models (LLMs) are increasingly utilized in domains such as finance, healthcare, and interpersonal relationships to provide advice tailored to user traits and contexts. However, this personalization often relies on sensitive data, raising critical privacy concerns and necessitating data minimization. To address these challenges, we propose a framework that integrates zero-knowledge proof (ZKP) technology, specifically zkVM, with LLM-based chatbots. This integration enables privacy-preserving data sharing by verifying user traits without disclosing sensitive information. Our research introduces both an architecture and a prompting strategy for this approach. Through empirical evaluation, we clarify the current constraints and performance limitations of both zkVM and the proposed prompting strategy, thereby demonstrating their practical feasibility in real-world scenarios.
GeoMFormer: A General Architecture for Geometric Molecular Representation Learning
Chen, Tianlang, Luo, Shengjie, He, Di, Zheng, Shuxin, Liu, Tie-Yan, Wang, Liwei
Molecular modeling, a central topic in quantum mechanics, aims to accurately calculate the properties and simulate the behaviors of molecular systems. The molecular model is governed by physical laws, which impose geometric constraints such as invariance and equivariance to coordinate rotation and translation. While numerous deep learning approaches have been developed to learn molecular representations under these constraints, most of them are built upon heuristic and costly modules. We argue that there is a strong need for a general and flexible framework for learning both invariant and equivariant features. In this work, we introduce a novel Transformer-based molecular model called GeoMFormer to achieve this goal. Using the standard Transformer modules, two separate streams are developed to maintain and learn invariant and equivariant representations. Carefully designed cross-attention modules bridge the two streams, allowing information fusion and enhancing geometric modeling in each stream. As a general and flexible architecture, we show that many previous architectures can be viewed as special instantiations of GeoMFormer. Extensive experiments are conducted to demonstrate the power of GeoMFormer. All empirical results show that GeoMFormer achieves strong performance on both invariant and equivariant tasks of different types and scales. Code and models will be made publicly available at https://github.com/c-tl/GeoMFormer.
The General Architecture for Time Series Forecasting solution
First, because time series forecasting aims to predict the future based on historical data, it usually has a high degree of uncertainty. Unlike other machine learning problems, the test set may differ from the training and validation sets drawn from historical data. Second, real-world time series data often suffer from missing and intermittently high data (such as when most of the time series values are 0). Some time-series tasks may not have available historical data and have cold-start problems, such as forecasting new product sales. Finally, time-series forecasts vary significantly across domains (product sales, web traffic, etc.), granularity (daily, hourly, etc.), historical length, and feature types (Categorical, Numeric, DateTime, etc.).
MMDetection: An Object Detection Python Tool - Analytics India Magazine
MMDetection is a Python toolbox built as a codebase exclusively for object detection and instance segmentation tasks. It is built in a modular way with PyTorch implementation. There are numerous methods available for object detection and instance segmentation collected from various well-acclaimed models. It enables quick training and inference with quality. On the other hand, the toolbox contains weights for more than 200 pre-trained networks, making the toolbox an instant solution in the object detection domain.
Business Event Curation: Merging Human and Automated Approaches
Wang, Yiqi (University of North Carolina at Chapel Hill) | Ma, Huiying (University of North Carolina at Chapel Hill) | Lowe, Nichola (University of North Carolina at Chapel Hill) | Feldman, Maryann (University of North Carolina at Chapel Hill) | Schmitt, Charles (University of North Carolina at Chapel Hill)
We present preliminary work to construct a knowledge curation system to advance research in the study of regional economics. The proposed system exploits natural language processing (NLP) techniques to automatically implement business event extraction, provides a user-facing interface to assist human curators, and a feedback loop to improve the performance of the Information Extraction Model for the automated parts of the system. Progress to date has shown that we can improve standard NLP approaches for entity and relationship extraction through heuristic means and provide indexing of extracted relationships to aid curation.